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FOREWORD 


This  report  aims  to  serve  two  purposes*  First,  it  compiles  and 
documents  the  methods,  techniques,  and  data  sources  that  can  be  used  to 
estimate  the  investment  costs  of  the  electronic  data  processing  equip¬ 
ment  of  Command  and  Control  systems*  As  such,  the  report  is  addressed 
to  the  practicing  cost  estimator*  Second,  this  document  is  addressed  to 
those  concerned  with  developing  new  cost-estimating  methodology.  In 
this  capacity,  it  presents  a  format  whereby  the  estimating  guidance  pro¬ 
vided  in  Chapter  6  of  Air  Force  Manual  AFSCL  173-1  (Cost  Estimating  Pro¬ 
cedures)^]  may  be  applied  to  estimate  the  cost  of  particular  items  of 
the  Program-Work  Breakdown  Structure  (WBS)  (Attachment  1)  of  the  manual. 
It  is  believed  that  similar  item-oriented  guidance  can  and  should  be  de¬ 
veloped  to  cover  the  major  "Levels  3,  4,  5,  and  6”  items  of  the  refer¬ 
enced  Structure.  For  instance,  the  typical  Level  5  items  that  might  be 
similarly  documented  are:  radar,  sensors,  computer  programming,  data 
display,  and  communications  subsystems  of  command  and  control  systems; 
the  airframe,  propulsion,  flight  control,  navigation  aids,  and  communi¬ 
cation  subsystems  of  aircraft  systems;  space  vehicles  and  re-entry  ve¬ 
hicles  of  space  systems;  ballistic  missile  vehicles,  training,  AGE,  and 
engineering  and  management  of  missile  systems. 

The  major  thesis  of  this  report  is  that  there  are  normally  several 
different  methods  of  estimating  the  costs  of  any  given  major  Air  Force 
system  item,  such  as  EDP  equipment.  This  report  describes  each  of  these 
basic  estimating  methods,  and  it  discusses  under  what  conditions  one 
method  is  to  be  preferred  to  another. 

Many  people  have  generously  contributed  their  specialized  knowledge 
of  EDP  equipment  and  its  cost  estimation  during  the  preparation  of  this 
document.  The  writer  is  especially  indebted  to  his  colleagues  in  MITRE's 
Department  D-53  (Systems  Analysis)  and  D-84  (Applied  Mathematical  Anal¬ 
ysis)  and  to  personnel  in  the  Cost  Analysis  Division  of  the  Air  Force* s 
Electronic  Systems  Division. 
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This  technical  report  has  been  reviewed  and  is  approved. 


KENNETH  K.  WALLICK,  Lt.  Colonel,  USAF 
Chief,  Cost  Analysis  Division  Comptroller 


ii 


ABSTRACT 


This  document  seeks  to  provide  practical  guidance  to  ana¬ 
lysts  charged  with  estimating  the  investment  costs  of 
the  electronic  data  processing  equipment  of  Air  Force 
Command  and  Control  systems.  The  document  is  also  of¬ 
fered  as  a  methodological  prototype  for  writing  similar 
item-oriented  reports  on  other  major  items  of  Air  Force 
systems,  such  as  communications  equipment,  radar,  sen¬ 
sors,  display  equipment,  computer  programming,  and  the 
major  subsystems  of  aircraft,  ballistic  missiles,  and 
space  systems. 
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SECTION  I 


INTRODUCTION 


DEFINITION 

The  glossary  included  in  Attachment  1  of  the  AFSCL  173-1  ^  does 
not  define  the  term.  Electronic  Data  Processing  Equipment  (EDP) .  As  a 
matter  of  fact,  it  is  not  easy  to  define  the  term  simply  or  to  every¬ 
one's  satisfaction.  One  of  the  problems  in  definition  is  in  selecting 
the  point  of  demarcation  between  EDP  equipment  and  the  sensor  and  com¬ 
munication  systems  which  record  and  transmit  information  to  the  EDP  sub¬ 
system  proper  and  between  the  data  display  systems  which  make  the  pro¬ 
cessed  data  available  in  usable  form  to  the  manager,  decision  maker, 
military  planner,  design  engineer,  and  other  users.  Historically,  the 
term  "EDP  equipment"  has  not  been  defined  consistently  from  one  cost 
study  to  another. 

This  report  will  not  attempt  to  resolve  the  definition  issue;  ac¬ 
tually,  the  content  of  the  report  has  not  been  geared  to  any  single 
definition  of  the  term.  However,  because  it  is  necessary  to  have  a 
general  bench  mark,  EDP  equipment  is  defined  to  comply  with  the  classi¬ 
fication  scheme  contained  in  the  Work  Breakdown  Structure  (WBS)  (Attach¬ 
ment  2  of  AFSCL  173-1  [ } ]  ).  Under  this  classification,  EDP  equipment 
is  established  as  one  of  the  six  major  item  categories  of  prime  mission 
equipment  of  a  Command  and  Control  system.  The  other  five  are:  radar, 
other  sensors,  computer  programming,  communications,  and  data  displays. 
Actually,  computer  programming,  is  not  an  equipment  item. 

The  WBS,  in  turn,  subdivides  EDP  into  four  major  subclasses:  the 
central  processor,  large  capacity  storage,  data  channels,  and  input/out¬ 
put  equipment.  A  fifth  "catch-all"  classification,  "other,"  picks  up 
such  items  as  certain  instruction  controls  and  arithmetic  elements  that 
do  not  always  fall  conveniently  into  one  of  the  four  major  classes. 
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SCOPE  OF  COSTS  COVERED 

Only  investment  or  production  costs  of  EDP  equipment  are  discussed 
in  this  report.  Excluded  from  this  study  are: 

(a)  the  RDT  &  E  costs  entailed  in  bringing  a  new  item  of  equipment 
from  concept  to  the  point  of  specification; 

(b)  the  development  and  investment  costs  of  computer  programs  to 
be  used  with  the  EDP  equipment; 

(c)  the  non-production  investment  costs  associated  with  the  EDP 
equipment  such  as  the  costs  of  installing  the  equipment  and 
the  initial  training  of  personnel  to  operate  the  equipment; 
and 

(d)  the  annual  costs  of  operating  and  maintaining  the  equipment 
once  it  has  been  acquired . 

MAGNITUDE  OF  EDP  COSTS 

Historically,  EDP  equipment  has  represented  a  major  item  of  cost 
in  most  Air  Force  Command  and  Control  systems.  The  specific  magnitude, 
however,  has  varied  greatly  from  system  to  system.  Ignoring  the  upper 
and  lower  extremes,  EDP  equipment  costs  have  generally  ranged  from  10 
percent  to  20  percent  of  total  investment  costs  for  most  Air  Force  Com¬ 
mand  and  Control  systems. 

In  most  cases,  the  central  processor  has  been  the  most  costly  item 
of  total  EDP  equipment.  Although  the  situation  may  vary  substantially 
from  case  to  case,  the  cost  of  the  central  processor  has  composed  roughly 
one-half  of  total  EDP  investment  costs.  The  other  three  major  items, 
large  capacity  storage,  data  channels,  and  input/output  equipment,  con¬ 
stitute  the  remaining  50  percent. 


2 


GENERAL  PLAN  OF  THE  REPORT 


Four  basic  methods  of  estimating  EDP  investment  costs  are  discussed 
in  this  report.  The  advantages  and  limitations  of  each  method  are  dis¬ 
cussed,  and  specific  data  sources  that  might  be  referenced  in  using  each 
method  are  identified.  First,  publicly  available  catalogs  are  used  to 
a  greater  extent  in  costing  EDP  equipment  than  they  are  used  in  most 
other  major  classes  of  electronic  equipment.  Second,  analogies  are 
widely  used  in  costing  EDP  equipment  just  as  they  are  used  in  costing 
other  items  of  equipment.  In  other  words,  the  cost  of  the  EDP  equip¬ 
ment  of  a  new  system  is  frequently  based  on  the  costs  of  similar  equip¬ 
ment  in  other  prior  systems.  Third,  relatively  extensive  research  has 
gone  into  the  development  of  parametric-estimating  relationships  (ERs) 
as  a  means  of  estimating  EDP  costs.  These  ERs  will  be  reviewed.  Fi¬ 
nally,  the  paper  discusses  how  the  cost  estimator  can  use  the  help  of 
EDP  experts  in  estimating  the  investment  costs  of  new  EDP  equipment. 
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SECTION  II 


EDP  CATALOGS 


TYPES  OF  CATALOG  INFORMATION 

Publicly  available  catalog  compendiums  provide  an  extensive  array 
of  cost  and  performance-design  data  on  EDP  equipment.  These  catalogs 
generally  contain  the  per  unit  prices  for  numerous  manufacturers'  models 
of  EDP  equipment. 

WHEN  CATALOGS  CAN  BE  USED 

These  catalogs  can  be  used  to  estimate  EDP  costs  when  the  equipment 
to  be  costed  is  a  standard,  off-the-shelf  commercial  item,  and  when  the 
office  requesting  the  cost  estimate  or  the  system  design  engineer  with 
whom  the  cost  estimator  is  working  can  identify  the  specific  manufac¬ 
turers'  EDP  model  to  be  costed.  This  specific  type  of  equipment  des¬ 
cription  information  is  likely  to  be  available  during  Contract  Defini¬ 
tion  (i.e.,  Definition  Phase)  or  the  Acquisition  Phase  of  a  System  Cycle. 
Frequently,  it  will  not  be  known  during  Concept  Formulation  (i.e.,  in 
the  Conceptual  Phase) . 

Although  primarily  applicable  to  costing  state-of-the-art  equip¬ 
ment,  catalog  prices  can  also  be  used  as  a  starting  point  for  costing 
new  types  of  EDP  equipment,  which  are  similar  to  but  slightly  more 
complex  or  advanced  than  current  manufacturers'  specification  models. 

The  catalog  price  would  then  be  a  data  source  for  using  the  "specific- 
analogy"  method  of  costing  discussed  in  Section  III. 

ADVANTAGES  OF  CATALOG  COSTING 

The  catalog  method  of  costing  has  the  following  advantages:  it  is 
likely  to  give  a  more  accurate  estimate  than  the  Estimating  Relationship 
method  of  estimation  described  in  Section  IV;  and  its  credibility  is 
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relatively  easy  to  establish  since  its  methodology  and  data  sources 
are  easily  traced  and  verified. 

DISADVANTAGES  OF  CATALOG  COSTING 

There  are  two  closely  allied  problems  associated  with  using  the 
catalog  method  of  estimating  EDP  investment  costs*  Frequently,  the 
cost  estimator  cannot  obtain  a  model  or  specification  type  description 
of  the  equipment  to  be  costed.  Without  such  a  description,  the  cata¬ 
log  method  of  costing  cannot  be  used.  Even  when  a  relatively  detailed 
design-type  description  of  the  desired  equipment  is  available,  there 
may  be  a  problem  in  using  the  catalog  method  of  costing  when  the  equip¬ 
ment  to  be  costed  does  not  match  any  catalog  item.  This  is  often  true, 
especially  when  the  cost  analysis  is  in  support  of  advanced  planning 
projects  which  require  EDP  equipment  having  performance  capabilities 
exceeding  the  current  state-of-the-art.  At  best,  in  such  situations, 
the  catalog  method  must  be  used  in  conjunction  with  some  of  the  other 
estimating  methods  described  in  the  following  sections, 

SPECIFIC  CATALOG  COMPENDIUMS 

There  are  at  least  five  major  catalog  compendiums  of  financial 
and  non- f inane ial  information  on  EDP  equipment.  These  are  described 
in  Exhibit  I. 

The  choice  of  a  specific  catalog  source,  when  it  is  appropriate  to 
use  catalog  costing,  depends  upon  a  host  of  considerations.  In  some 
circumstances,  there  is  the  question  of  availability.  All  cost  esti¬ 
mators  do  not  have  access  to  all  EDP  catalogs.  Also,  some  catalogs 
are  easier  to  reference  than  others,  and  when  a  quick  answer  is  re¬ 
quired,  the  ea s ier- to -re f erence  catalogs  may  be  considered  first. 
Finally,  there  is  the  question  of  accuracy.  Accuracy  requirements  vary 
from  case  to  case.  Some  catalog  compendiums,  because  of  their  greater 
detail  or  more  frequent  updating,  will  give  a  more  accurate  estimate  of 
EDP  costs  than  otiver  compendiums. 
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EDP  Equipment  Catalog  Compendiums 


6 


EXHIBIT  I  (Continued) 

EDP  Equipment  Catalog  Compendiums 
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EDP  Equipment  Catalog  Compendiums 
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Furnished  free  of  charge  to  government  agencies,  Catalog  #1 
(G.S.A.)  provides  the  latest,  most  authoritative  prices  to  the  Govern¬ 
ment  of  current  specification  computers.  However,  if  the  computer  is 
to  be  purchased  by  a  government  contractor,  rather  than  directly  by  the 
Government,  GSA  prices  will  probably  understate  the  correct  price. 

The  eight-volume  Auerbach  reports  cost  $695  per  year  and  contain 
more  than  5,000  small  print,  8-1/2"  x  11"  pages  of  detail.  These  re¬ 
ports  are  a  useful  reference  to  the  cost  estimator  when  the  system  de¬ 
signer  can  specify  a  highly  detailed  description  of  the  EDP  equipment 
configuration  to  be  costed  and  when  a  high  degree  of  accuracy  in  the 
cost  estimate  is  required.  Among  the  major  advantages  of  the  Auerbach 
reports  is  that  they  summarize  and  consolidate  the  many  thousands  of 
pages  contained  in  the  equipment  catalogs  of  different  EDP  equipment 
manufacturers.  The  Auerbach  reports  also  seek  to  evaluate  and  rate 
objectively  the  comparative  capability  of  different  manufacturers' 
equipment  to  perform  specified  EDP  tasks.  For  many  costing  assignments, 
however,  the  cost  estimator  can  work  at  a  higher  level  of  aggregation 
than  that  provided  by  the  Auerbach  reports. 

The  major  advantage  of  the  Adams  Associates  catalog  is  its  compact, 
easy- to-ref erence  format.  For  instance,  the  vest-pocket  edition  of 
Adams  catalog  is  small  enough  to  fit  into  a  man's  shirt  pocket  and 
sells  for  $10  per  year  for  four  quarterly  issues.  It  gives  the  costs 
and  major  performance-design  parameters  of  representative  configura¬ 
tions  of  about  200  business  and  scientific  computers.  The  costs  are 
expressed  as  monthly  rentals,  which  can  generally  be  converted  to 
approximate  purchase  prices  by  multiplying  the  monthly  rentals  by  a 
factor  between  40  and  50;  the  exact  figure  depends  upon  manufacturer, 
model5 and  type  of  machine.  However,  the  range  of  costs  for  a  basic 
computer  reported  by  Adams  are,  typically,  fairly  wide  because  total 
EDP  equipment  costs  depend  so  importantly  on  the  specific  equipment 
configuration  involved.  Hence,  when  specific  EDP  configuration  des- 
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criptions  are  available,  the  G.S.A.  or  other,  more  detailed  catalogs 
should  be  used. 

The  Department  of  Army  catalogs  (sources  2  and  3,  Exhibit  I)  are 
much  more  detailed  than  the  Adams  and  much  less  detailed  than  the  Auer¬ 
bach  catalogs.  The  standard  comparative  tables  which  are  provided  by 
the  Army  catalogs,  cover  both  current  and  superseded  computers,  and 
they  furnish  a  good  basis  for  parametric  cost  studies  requiring  a  broad, 
historical  coverage  of  performance,  design,  and  cost  characteristics. 
The  fact  that  these  documents  are  available  without  charge  to  qualified 
requestors  through  the  Defense  Document  Center  or  the  Clearing  House 
for  Federal  Scientific  and  Technical  Information  makes  them  accessible 
to  practically  all  estimators  who  need  EDP  cost  data.  An  indefinite 
updating  schedule  is  one  drawback  of  the  Army  catalogs.  There  was  no 
1965  edition,  and  apparently  none  is  definitely  scheduled  beyond  the 
1964  edition. 

In  addition  to  the  catalogs  referenced  above,  a  number  of  trade 
magazines,  such  as  Computers  and  Automation,  Business  Automation, 
Electronic  News,  Datamation ,  etc per iodical ly  provide  catalog-type 
cost  and  specification  information  on  major  computers. 
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SECTION  III 


ANALOGOUS  EDP  APPLICATIONS 


DEFINITION 

Sometimes,  a  cost  estimator  will  base  his  estimate  of  the  costs  of 
the  EDP  equipment  of  a  new  system  on  the  costs  of  closely  analogous  or 
identical  EDP  equipment  used  in  some  other  system(s).  These  costs  from 
analogous  systems  may  take  the  form  of  contractor  actuals  or  of  contrac¬ 
tor  or  Air  Force  estimates  for  such  analogous  equipment. 

WHEN  USED 

Analogies  are  useful  as  a  basis  for  estimating  EDP  equipment  costs 
under  several  circumstances: 

(a)  One  instance  would  be  when  the  new  computer  to  be  costed  is  a 
military  specification  computer  or  a  militarized  version  of  a 
standard,  commercial  computer  for  which  there  is  no  standard 
catalog  price. 

(b)  In  some  advanced  planning  or  conceptual  phase  studies,  system 
design  engineers  may  not  be  in  a  position  to  specify  a  partic¬ 
ular  manufacturer's  model  as  being  the  one  desired.  Occasion¬ 
ally,  the  engineers  may  not  even  be  able  to  specify  the  gen¬ 
eral  performance  requirements  (storage  capacity,  processing 
speed,  etc.)  desired  of  the  new  computer.  Sometimes,  the  only 
guidance  that  the  project  engineers  can  give  the  cost  estima¬ 
tor  is  to  liken  the  type  of  EDP  functions  to  be  performed  and 
the  general  magnitude  of  the  EDP  workload  for  the  new  system 
to  those  in  another  specified  system.  In  such  instances,  the 
cost  estimator's  only  basis  for  estimating  the  EDP  costs  of 
the  new  system  is  to  try  to  determine  what  were  (have  been) 
the  EDP  equipment  costs  of  the  specified  analogous  system. 
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LIMITATIONS 


There  are  several  problems  in  using  analogies  as  an  estimating 
basis.  First,  no  two  EDP  applications  are  identical.  Sometimes,  the 
analogies  suggested  by  the  project  engineers,  although  the  best  immedi¬ 
ately  available,  may  prove  to  be  remote.  Even  if  the  engineering  as¬ 
pects  of  the  EDP  equipment  of  the  new  and  old  systems  are  similar,  the 
resource  requirements  may  be  vastly  different.  For  instance,  the  first 
application  may  have  been  plagued  by  cos t- inducing  engineering  changes 
that  are  not  likely  to  occur  in  later  applications.  Stated  more  gener¬ 
ally,  as  equipment  evolves  from  one  production  level  or  time  period  to 
another,  learning  curve  or  price  level  changes  may  necessitate  major 
revisions  in  per  unit  EDP  equipment  costs. 


Second,  it  is  frequently  difficult  for  the  cost  analyst  to  obtain 
reliable  costs  on  the  analogous  EDP  application.  Very  often,  the  only 
costs  obtainable  on  the  analogous  application  are  estimated  costs  as 
opposed  to  actual  costs.  There  are  several  reasons  for  this.  First, 
historically,  on  many  contracts  the  Air  Force  has  not  received  item-by- 
item  breakdowns  of  contractor  actuals.  (Under  the  new  AFSCL  173-2  Cost 
Information  System,  item-by-item  breakdowns  of  contractor  actuals  may 
be  provided  more  frequently  than  in  the  past.)  Second,  when  the  item 
cost  actuals  do  become  available,  they  are  often  treated  as  highly 
proprietary  and  are  not  available  to  cost  estimators  at  all  echelons 
and  in  all  organiza tions .  Third,  it  is  sometimes  hard  to  evaluate  the 
validity  and  applicability  of  the  item  cost  actuals  reported.  For  in¬ 
stance,  the  term,  "EDP  investment  cost,"  is  not  always  defined  in  the 
same  way  by  a  contractor  as  it  is  by  an  Air  Force  cost  analyst. 

Thus,  because  actual  cost  data  are  often  hard  to  obtain,  the  spe¬ 
cific  analogy  method  of  estimation,  historically,  has  often  involved 
using  a  prior  cost  estimate  as  a  base  to  make  a  future  cost  estimate. 
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This  procedure  is  hazardous  simply  because,  historically,  many  prior 
estimates  have  been  seriously  in  error.* 

PINPOINTING  SIMILARITIES  AND  DIFFERENCES 

Notwithstanding  the  problems  in  using  the  specific  analogy  method 
of  estimation,  it  is  very  frequently  used  by  cost  estimators  since  the 
problems  in  using  other  estimating  methods  are  often  even  more  difficult. 
There  are  various  data  sources  that  can  be  employed  in  using  the  spe¬ 
cific  analogy  method  to  estimate  EDP  investment  costs. 

MITRE  has  made  studies  which  can  aid  the  cost  estimator  in  deter¬ 
mining  how  similar  a  new  EDP  equipment  requirement  is  as  compared  to 
previous  or  contemporary  EDP  equipment  on  which  he  has  cost  data.  E2  *  ll 

These  studies,  which  were  undertaken  to  assist  the  Air  Force  in 
procuring  EDP  equipment,  list  among  other  things  several  hundred  per¬ 
formance  or  design  parameters  of  EDP  equipment  that  may  influence  the 
cost  as  well  as  the  effectiveness  of  such  equipment.  Illustrative  of 
such  parameters  are:  the  size,  access  time,  cycle  time,  etc.,  of  the 
main  memory  unit  of  the  central  processor,  the  storage  capacity,  access 
time,  minimum  addressable  record  length,  etc.,  of  the  intermediate  ac¬ 
cess  storage  (disk,  drum,  magnetic  tape).  Among  the  more  general  phys¬ 
ical  parameters  of  the  total  EDP  equipment  system  are  weight,  cubage, 
power  requirements,  etc.  Even  more  general  are:  ease  of  maintenance, 
survivability,  security  provisions,  etc. 


*  A  number  of  studies  (RAND,  Peck  &  Sherer ,  etc.)  have  quantified  this 
error.  Charles  J.  Hitch,  former  Department  of  Defense  Comptroller, 
recently  stated:  "There  is  first  the  problem  of  estimating  the  de¬ 
velopment  and  production  costs  of  new  weapon  systems.  The  record  of 
the  Department  over  the  past  fifteen  years  has  been  spectacularly 
bad.  We  and  our  contractors  have  typically  underestimated  costs  by 
factors  of  two  to  ten.  (Not  2  to  10  percent,  but  100  to  900  percent,)" 
Charles  J.  Hitch,  Decision-Making  for  Defense,  University  of  Cali¬ 
fornia  Press,  1965,  p.  64 
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As  indicated  above,  the  referenced  MITRE  studies  provide  check¬ 
lists  for  systematically  identifying  the  areas  of  cost- indue ing  differ¬ 
ences  in  performance  and  design  between  proposed  or  new  EDP  equipment 
and  previous  or  contemporary  EDP  equipment. 


SPECIFIC  ANALOGIES 

A  useful  source  for  learning  what  types  of  EDP  equipment  particu¬ 
lar  agencies  of  the  Federal  Government  (military  and  non-military)  are 
using,  what  the  costs  of  these  equipments  are,  where  each  specific  item 
of  EDP  equipment  is  located  geographically,  and  to  what  applications 
these  equipments  are  being  put  are  reported  in  Inventory  of  Automatic 
Data  Processing  (ADP)  Equipment  in  the  Federal  Government .  M 

A  useful  source  for  finding  out  what  types  of  EDP  equipment  the 
Air  Force  is  currently  using  at  specific  Air  Force  bases  and  for  what 
purposes  or  to  what  applications  this  equipment  is  being  put  is  Data 
Systems  Automation  Program. 

A  limitation  of  these  sources  is  that  their  data  is  approximate 
and  partial  rather  than  precise  and  complete.  Costs  are  coded  in  broad 
ranges;  it  is  difficult  to  associate  the  equipment  applications  to  par¬ 
ticular  "LM  systems;  the  geographic  locations  are  approximate  (e.g., 
MITRE’s  location  is  stated  as  Framingham  rather  than  as  Bedford),  and 
only  the  basic  computer  is  identified  rather  than  the  full  EDP  config¬ 
uration  . 
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SECTION  IV 


COST-ESTIMATING  RELATIONSHIPS 


TYPES  OF  CERs 

Both  the  Air  Force  and  its  not-for-profit  technical  support  con¬ 
tractors  have  developed  Cost-Estimating  Relationships  (CERs)  that  may 
be  used  under  limited  circumstances  to  estimate  certain  EDP  equipment 
costs, 

These  CERs  are  equations  which  provide  the  means  for  estimating 
the  investment  costs  of  a  unit  of  EDP  equipment  based  on  the  values  of 
one  or  more  of  the  equipment's  performance  parameters  such  as  storage 
cycle  time,  complete  add  time,  minimum  core  storage  capacity,  etc. 

WHEN  THESE  CERs  MAY  BE  USED 

These  CERs  may  be  used  to  estimate  EDP  costs  when  the  cost  estima¬ 
tor  is  able  to  secure  only  a  very  limited  description  of  the  equipment 
that  he  is  to  cost;  when  he  is  able  to  learn  only  what  the  performance 
capabilities  of  the  equipment  are  to  be,  not  what  it  will  look  like, 
the  nature  of  its  design,  its  specification  number,  or  the  manufactur¬ 
er's  model  number.  Usually,  this  limited  information  is  likely  to  be 
available  during  a  system's  Concept  Formulation.  Limited  description 
information  may  also  be  available  beyond  the  Concept  Formulation  when 
the  computer  required  is  different  (somewhat  advanced)  from  any  current 
specification  computer.  Under  such  circumstances,  especially  if  the 
time  available  in  which  to  make  the  estimate  is  very  short,  the  use  of 
parametric  CERs  may  be  a  valuable  means  of  getting  a  rough  estimate  of 
a  new  computer's  cost. 

A  parametric  CER  also  can  provide  a  quick,  simple  means  of  double¬ 
checking  the  estimate  derived  by  other  estimating  methods. 
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LIMITATIONS  OF  CERs 


Since  considerable  research  effort  has  been  spent  in  developing 
parametric  CERs  for  EDP  equipment,  and  since  even  greater  effort  is  in 
process  in  developing  such  CERs  in  all  fields  of  military  costs,  it  is 
appropriate  to  consider  here  the  problems  and  limitations  relative  to 
using  such  CERs 

One,  the  relatively  limited  set  of  circumstances  under  which  a 
parametric  EDP  CER  is  the  preferred  method  of  estimation  is  one  of  the 
severest  limitations  of  this  estimating  method.  Where  specification 
type  description  information  is  available,  a  catalog  price  or  a  specific 
EDP  analogy  will  normally  provide  a  more  accurate  estimate.  Where  only 
task-workload  type  information  is  available,  EDP  CERs  that  have  been  de¬ 
veloped  to  date  cannot  be  used;  a  specific  task-workload  analogy  must 
be  found. 

Two,  even  when  the  conditions  are  propitious  for  using  parametric 
CERs,  they  must  be  used  with  great  discretion.  In  the  EDP  field,  the 
pace  of  technological  progress  is  rapid,  and  there  is  a  longrun  trend 
of  greater  overall  computing  power  per  dollar  spent.  To  cite  a  dramatic 
example,  Diebold  recently  forecast  that  for  typical  ’’chip  systems’'  image 
files  the  cost  per  unit  stored  will  decline  from  $1.00  in  1964  to  $0.60 
in  1966  to  $0,004  in  1973.  ^  What  this  means  is  that,  wherever  advanced 
developments  are  concerned,  CERs  based  on  historical  costs  must  be  ad¬ 
justed  for  the  longrun  declining  cost  factor.  To  determine  this  ad¬ 
justment  factor,  the  cost  analyst  should  check  with  experts  in  partic¬ 
ular  fields  of  EDP  technology. 

In  addition  to  these  general  precautions,  several  other  reserva¬ 
tions  should  be  made  relative  to  the  available  parametric  CERs  on  EDP 
equipment.  First,  two  of  the  organizations  (System  Development  Corpor¬ 
ation  and  RAND  Corporation)  that  have  tried  to  develop  parametric  CERs 
for  EDP  equipment  arrived  at  essentially  inconclusive  or  negative 
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findings.  SDC  found  no  consistent,  reliable  relationship  between  EDP 


cost  and  EDP  performance  parameters,  whereas  RAND  imposed  severe  limita¬ 
tions  on  the  EDP  CER  it  developed.  ^ 

Another  qualification  is  that  most  EDP  CERs  have  been  based  predom¬ 
inantly  on  general  purpose  computers.  Frequently,  however,  Air  Force 
Command  and  Control  systems  require  special  purpose  computers  or  a 
special  adaptation  of  general  purpose  computers. 

Finally,  no  CER  covering  total  EDP  investment  costs  (WBS  Level  5) 
has  been  developed  by  anyone.  The  CERs  developed  to  date  have  covered 
either  the  central  processor  or  large  capacity  storage  units.  None  has 
been  developed  covering  data  channels,  input-output  equipment,  or  other 
miscellaneous  EDP  items. 

Conceivably,  it  might  be  possible  to  estimate  these  latter  three 
categories  of  EDP  equipment  as  a  factor  or  percentage  of  the  central 
processor  and  large  capacity  storage  costs.  However,  no  one  to  date 
has  developed  such  an  ER.  RAND,  which  has  worked  on  EDP  CERs,  cautions 
against  expectations  for  such  cost-to-cost  CERs  because  the  peripheral 
equipment  configuration  varies  so  drastically  from  one  EDP  application 
to  the  next.  Rapidly  advancing  technology  also  makes  it  difficult  to 
establish  any  stable  relationship  between  one  type  of  EDP  cost  and  an¬ 
other.  For  instance,  Diebold  estimates  that  between  1963  and  1973  the 

cost  of  the  main  frame  and  operating  memory  will  decline  from  33  percent 

[Y] 

to  21  percent  of  total  EDP  costs  in  a  typical  manufacturing  plant. 
SPECIFIC  CERs 

(a)  AFSC  (ESD)  has  developed  two  major  EDP  parametric  CERs. 


is : 


Y  =  the  acquisition  cost  of  the  central  processor  in 
c  millions  of  dollars; 
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X 


=  the  speed  of  the  equipment  defined  as  the  time,  in 
microseconds,  required  to  execute  an  add  instruction 
or  a  given  sequence  of  arithmetic  or  logical  instruc¬ 
tions  including  the  storage  access  time  . 

The  coefficient  of  correlation  for  the  estimating  equation  is 

0.745,  and  the  standard  error  of  estimate  is  0.0775. 


The  second  ESD  EDP  CER 


[10] 


is : 


Y 

c 


.8726 

1  ,734  (X) 


Y  =  the  acquisition  cost  in  dollars  of  the  EDP  magnetic 
core  storage  unit; 

X  =  the  storage  capacity  of  the  memory  unit  in  binary 
digits  (bits)  divided  by  1000. 


The  coefficient  of  correlation  of  the  estimating  equation  is 
0.9752,  and  the  standard  error  of  estimate  is  0.1020. 

The  ESD  CERs  apply  to  computers  bought  by  the  Federal  Govern¬ 
ment.  Computers  bought  by  military  contractors  would  probably 
be  somewhat  higher  in  price. 

[8] 

(b)  RAND  has  developed  the  following  CER 
R  =  0.37  +  .033  (eye)  +  .015M  ; 

R  =  monthly  rental  in  thousands  of  dollars  of  the  equip¬ 
ment  group  composed  of  the  central  processor,  memory, 
and  associated  control  modules  • 

eye  =  the  number  of  memory  cycles  per  second,  in  thousands 
(the  reciprocal  of  cycle  time); 

M  =  memory  core  capacity  in  M  bits. 


RAND  cautions  that  the  referenced  equation  does  not  closely 
fit  the  observations  used  to  derive  it,  especially  for  smaller 
machines.  The  coefficient  of  correlation  of  the  estimating 
equation  is  0.91. 
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(c)  MITRE  has  developed  a  series  of  eight  EDP  CERs  as  shown  in 
Exhibit  II. These  CERs  provide  the  basis  for  computing 
the  cost  of  the  computer  central  complex  using  minimum  core 
storage  capacity  and/or  complete  add  time  as  the  independent 
variables.  The  estimating  equations  were  derived  from  ob¬ 
servations  taken  on  15  computers  in  the  field  in  1963. 

The  MITRE  CERs  apply  to  general  purpose,  digital  computers 
having  greater  than  100,000  bits  minimum  core  storage  capac¬ 
ity  and  with  a  central  processor  cost  exceeding  $300,000. 

(d)  The  Diebold  Group,  Inc computer  research  consultants, 
has  provided  a  series  of  ERs  oriented  toward  future 
EDP  developments.  The  Diebold  study  represents  an  in¬ 
tensive  three-year  project  in  which  80  large  U.S.  and 
European  corporations  have  participated.  One  of  the 
Diebold  summary  charts  is  reproduced  as  Exhibit  IV. 

These  types  of  projected  factors,  which  represent  a 
distillation  of  expert  opinions  (see  Section  V),  may 
be  quite  useful  to  an  estimator  for  obtaining  a  "quick 
fix"  on  the  likely  financial  impact  of  specific  new 
developments  in  EDP  technology.  Two  qualifications, 
however,  apply  to  these  ERs.  First,  the  ERs  have  been 
formulated  at  a  lower  level  of  item  detail  than  many 
Air  Force  cost  estimators  are  accustomed  to  working. 

Second,  such  factors  inherently  have  a  strong  subjec¬ 
tive  basis  and  can  provide,  at  best,  only  a  highly 
gross  estimate. 
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EXHIBIT  II 
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EXHIBIT  III 


INFORMATION-PROCESSING  DEVELOPMENTS 
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Taken  from  Harvard  Business  Review,  September-October  1965 
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SECTION  V 


EDP  EXPERTS 

COST  APPLICATIONS  OF  EDP  EXPERTISE 

Experts  in  various  areas  of  EDP  technology  are  frequently  useful 
to  the  cost  estimator  in  estimating  the  EDP  equipment  costs  of  a  new 
system.  First,  such  experts  may  help  the  cost  estimator  surmise  the 
design  implications  of  a  new,  enhanced  EDP  performance  requirement. 

For  instance,  the  EDP  engineer  may  provide  an  informed  opinion  as  to 
what  effect  on  the  equipment’s  size,  weight,  internal  circuitry,  etc., 
that  a  100  percent  increase  in  the  data-processing  rate  or  internal 
memory  capacity  would  have.  Second,  the  EDP  experts  may  provide  the 
cost  estimator  with  an  engineering  estimate  relative  to  the  effect  of 
changes  in  engineering  complexity,  in  size,  or  in  weight  of  the  equip¬ 
ment  on  per  unit  EDP  investment  costs. 


WHEN  TO  USE  EXPERTS 

EDP  equipment  experts  are  likely  to  be  useful  consultants  to  the 
cost  estimator  under  several  sets  of  circumstances. 

(a)  When  the  new  computer  to  be  costed  necessitates  a  new,  complex 
development  in  technology  over  and  above  that  embodied  in  any 
current  specification  computer,  experts  may  provide  more  up- 
to-date,  relevant  guidance  on  both  configuration  and  costs 
than  that  afforded  in  published  catalog  prices  or  parametric 
CERs  based  on  state-of-the-art  equipment. 

(b)  When  other  methods  of  estimating  the  cost  of  new  EDP  equip¬ 
ment,  such  as  catalog  prices,  parametric  CERs,  contractor 
actuals,  or  estimates  on  the  costs  of  analogous  equipment, 
are  in  sharp  conflict  relative  to  the  appropriate  estimated 
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cost  of  the  new  computer,  a  recourse  to  experts  may  help  to  re¬ 
solve  or  compromise  the  conflict. 

(c)  When  the  time  available  in  which  to  estimate  the  EDP  costs  is 

too  short  to  locate  and  analyze  catalog  prices,  contractor  rec¬ 
ords,  or  parametric  CERs,  the  estimator  can  often  quickly  ob¬ 
tain  an  order-of -magnitude  cost  estimate  for  the  new  computer 
from  an  expert  who  is  in  close,  constant  touch  with  the  latest 
developments  in  the  EDP  field. 

LIMITATIONS 

The  most  frequent  problem  in  using  experts  is  that  the  cost  estimar 
tor  often  receives  little  or  no  traceable  supporting  data  or  methodology 
to  substantiate  the  expert's  opinion.  Of  course,  sometimes  an  EDP  ex¬ 
pert  will  support  his  "considered"  opinion  with  full  documentation  that 
traces  each  step  of  his  reasoning.  However,  in  many  cases  expert  opin¬ 
ions  are  purely  intuitive,  and  the  cost  estimator  receives  little  or  no 
insight  relative  to  the  process  that  the  expert  used  to  reach  his  opin¬ 
ion.  The  problems  of  evaluating  such  undocumented  opinions  are  height¬ 
ened  by  the  fact  that  many  of  the  most  knowledgeable  computer  experts 
are  employed  by  the  leading  manufacturers  of  computer  equipment.  It  is 
reasonable  to  presume  that  the  opinions  of  these  experts  are  sometimes 
slanted  to  reflect  favorably  on  the  computers  manufactured  by  or  being 
developed  by  their  employers. 

Another  problem  in  using  outside  experts  for  opinions  is  that  pro¬ 
ject  ground  rules  sometimes  deny  Air  Force  cost  estimators  access  to 
contractor  sources  when  making  "  independent1'  Air  Force  cost  estimates. 


SOURCES  OF  EDP  EXPERTISE 


AFSCL  173-1,  (pp.  4-10  and  4-11)  establishes  as  a  longrun  project 
the  preparation  of  an  "Expert  Source  Record"  (AFSC  Form  12)  for  all 
major  items  of  Air  Force  systems.  The  following  provides  a  start 
toward  a  "Hanscom  Complex"  EDP  expert  list: 
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(a)  Air  Force  Sources 


1.  ESD ,  Directorate  of  Technology,  Computer  Division 

2.  ESD,  EDP  Equipment  Office 

3.  ESD}  Comptroller,  Cost  Analysis  Division  (for  cost  data) 

(b)  The  MITRE  Corporation 


1.  Department  71,  Computer  &  Display  Technology 

2.  Department  84,  Applied  Mathematics  (for  technical  charac¬ 
teristics  of  EDP  equipment  affecting  cost) 

3.  Department  53,  Systems  Analysis  (for  cost  data) 

4.  Division  5,  Planning  Staff 

(c)  Industrial  Sources 


The  publicly  available  manufacturers*  catalogs  plus  Air  Force 
contractor  records  provide  relatively  thorough  guidance  as  to 
which  companies  are  manufacturers  of  and  experts  for  particu¬ 
lar  types  of  computers.  Air  Force  cost  estimators  have  sev¬ 
eral  means  of  identifying  particular  departments  or  individu¬ 
als  within  these  companies  as  experts  on  particular  computer 
areas.  First,  either  of  the  Air  Force  EDP  expert  sources, 
identified  in  (a)  and  (b)  above,  can  provide  useful  guidance 
on  this  matter.  Second,  the  U.S.  Organization  Chart  Service, 
a  private  quarterly  publication,  identifies  the  major  depart¬ 
ments  and  personnel  of  all  leading  industrial  companies,  in¬ 
cluding  EDP  manufacturers.  Also,  private  EDP  evaluative  or¬ 
ganizations,  such  as  Auerbach,  Diebold,  and  Adams  Associates, 
have  a  good  working  knowledge  of  industrial  expertise  for  EDP 
equipment,  plus  a  substantial  in-house  capability  on  their 
own  staffs. 
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SECTION  VI 


SUMMARY 

This  report  has  tried  to  show  that  a  cost  analyst  who  estimates 
EDP  equipment  costs  has  at  his  disposal  a  kit  of  estimating  tools 
rather  than  a  single  method.  Also,  it  has  been  stressed  that  none  of 
the  various  estimating  methods  has  an  inherent,  universal,  clear-cut 
advantage  over  the  others.  In  any  given  case,  the  preferred  estimating 
method  will  depend  upon  many  considerations  such  as:  how  well  (how 
specifically)  the  EDP  equipment  to  be  costed  is  described;  the  types  of 
documented  data  plus  expert  sources  available  to  the  estimator;  whether 
or  not  a  high  degree  of  accuracy  in  the  cost  estimate  is  important;  and 
the  length  of  time  the  estimator  has  to  make  his  estimate. 

Frequently,  because  of  data  inadequacies  and  other  problems,  the 
analyst  will  find  it  advantageous  to  use  two  or  more  methods  to  esti¬ 
mate  EDP  equipment  costs,  even  if  a  second  or  third  method  is  used  only 
to  check  the  results  provided  by  the  first. 

Exhibit  III  provides  a  highly  simplified,  generalized  cost-estima¬ 
ting  matrix  that  attempts  to  recap  procedurally  the  salient  features  of 
this  report. 

Finally,  note  should  be  made  of  the  need  for  further  and  continuing 
work  in  this  area  of  EDP  cost-estimating  methodology.  This  work  should 
be  of  three  types: 

(a)  First,  there  is  the  question  of  normal  updating.  Some  of  the 
specific  content  of  the  report  is  relatively  perishable.  New 
catalog  services,  new  estimating  relationships,  new  experts, 
and  new  analogous  EDP  applications  will  certainly  become 
available.  Periodically,  a  document  of  this  type  should  be 
revised  to  reflect  such  new  information. 
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Generalized  Cost-Estimating  Matrix 
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f  Status  monitoring  -  1000  weapons  in  "near"  real-time. 
Interception  -  simultaneously  perform  25  intercepts. 
Detection  -  0.999  probability,  m^  target. 


EXHIBIT  IV  (Continued) 
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EXHIBIT  IV  (Continued) 
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(b)  Second,  the  technique  and  data  source  portions  of  the  report 
could  profitably  be  expanded: 

(1)  Certain  methodological  issues  recently  explored  in  a 
generalized  context  should  be  discussed  in  the  specific 
context  of  estimating  EDP  equipment  costs,  for  instance: 
how  should  an  analyst  proceed  when  he  has  several  more 
or  less  analogous  EDP  sources;  how  should  he  select  con¬ 
sultants  or  experts  in  particular  EDP  areas;  and  how 
should  he  comparatively  evaluate  a  host  of  heterogeneous 
EDP  data  sources  to  arrive  at  a  final  cost  estimate  that 
gives  due  consideration  to  all  of  his  available  informa¬ 
tion  .  * 

(2)  A  later  edition  of  the  report  will  expand  the  specific- 
analogue  guidance  discussed  in  Section  III  relative  to 
computers  used  in  Air  Force  Command  and  Control  systems. 

(3)  A  later  edition  will  also  incorporate  the  data  that  will 
be  collected  on  AFSC  Forms  12,  Expert  Source  Record, 
relative  to  EDP  experts. 

(4)  Similar  item-oriented,  cost-estimating  guidance  reports 
will  be  written  on  computer  programming  and  on  EDP  equip¬ 
ment  development  and  operating  cost  estimating. 

(c)  Finally,  a  future  revision  of  this  report  will  include  a  case 
study  that  will  illustrate  in  a  step-by-step,  real-life  con¬ 
text  how  an  analyst  should  use  the  techniques  and  information 
sources  discussed  in  this  report. 


*  For  a  brief,  general  discussion  of  these  issues,  see: 

AFSC  L  173-1,  Cost  Estimating  Procedures,  Chapter  4,  Sections  C  and 
D;  UJ  and  M.  V.  Jones,  Estimating  Methods  and  Data  Sources  Used  in 
Costing  Military  Systems,  MITRE  TM-4263,  June  1965,  33-45. 
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